Rate-distortion optimized streaming of compressed light fields
نویسندگان
چکیده
We propose a framework for the streaming of light fields over a lossy error-prone packet network. This system is optimized for the end-user according to a rate-distortion criterion. We build upon recent rate-distortion optimized streaming work for audio and video data. We extend this work to light field image data by introducing view-dependent distortion, multiple playout deadlines, and statebased distortion. In our experimental results, the rate-distortion optimized framework has a bit-rate reduction of up to 75% over a heuristic rule-based system.
منابع مشابه
Rate-distortion Optimized Streaming of Compressed Light Fields with Multiple Representations
Image-based rendering has been proposed as a way of enabling interactive photorealistic viewing of objects and scenes without the complexity of traditional computer graphics rendering techniques. Image-based rendering, however, relies on a large amount of image data to achieve photorealistic quality and freedom in viewing directions and position. This poses several challenges for remote viewing...
متن کاملAnalysis-by-synthesis distortion computation for rate-distortion optimized multimedia streaming
This paper presents an analysis-by-synthesis technique to evaluate the perceptual importance of multimedia packets for ratedistortion optimized streaming. The proposed technique, instead of relying on a priori information, computes the distortion that would be caused by the loss of each single packet, including the effects of error propagation and receiver-side error concealment. A rate-distort...
متن کاملRate-Distortion Optimized Interactive Streaming for Scalable Bitstreams of Light Fields
A rate-distortion optimized scheme for interactive light field streaming is proposed. The light field data set is transformed into blocks of wavelet coefficients; each block is coded as a scalable bitstream and stored at the sender. To render a frame, the receiver issues a request for relevant data. Based on the request, the estimated state of the data already at the receiver, the network chara...
متن کاملTheoretical Analysis of the Rate-distortion Performance of a Light Field Streaming System
Large image-based rendering data sets such as light fields require efficient compression and random access to individual images for applications such as interactive streaming to a remote user. In our earlier work, we propose a theoretical framework to analyze the trade-off between compression efficiency and random access. In this current paper, we extend the theoretical framework by calculating...
متن کاملServer diversity in rate-distortion optimized media streaming
We consider diversity for media streaming in a receiver-driven rate-distortion optimization framework. Diversity is achieved by requesting media packets from multiple servers. A framework is proposed that enables the receiver to decide at every instant which packets, if any, to request for transmission and from which servers in order to meet a rate constraint while minimizing the end-toend dist...
متن کامل